Sensorimotor interfaces : towards enactivity in HCI

This thesis explores the application of enactive techniques to human computer interaction, focusing on how devices following ‘sensorimotor’ principles can be blended with interface goals to lead to new perceptual experiences. Building sensorimotor interfaces is an exciting, emerging field of research facing challenges surrounding application, design, training and uptake. To tackle these challenges, this thesis cuts a line of investigation from a review of enactivity in the related field of sensory substitution and augmentation devices, to a schematic taxonomy, model and design guide of ‘the sensorimotor interface’; developed from a theoretically-grounded, enactive approach to cognition. Device, interaction and training guidelines are drawn from this model, formalising the application of the enactive approach to HCI. A readily-available consumer device is then characterised and calibrated in preparation for testing the model validity and associated insights. The process highlights the effects of accessible, easily-implemented calibrations, and the importance of mixed-method approaches in assessing sensorimotor interface potential. The calibrated device is utilised to conduct a detailed, methodological investigation into how concurrently available sensory information affects and contributes to uptake of novel sensorimotor skills. Robust statistical modelling concludes that sensory concurrency has a profound effect on the comprehension and integration of enactive haptic signals, and that efforts to carefully control the nature and degree of sensory concurrency improve user comprehension and enjoyability when engaging with novel sensorimotor tasks, while reducing confusion and stress. The work is concluded by speculation on how the presented derivations, methods and observations can be used to directly influence future sensorimotor interface design in HCI. This thesis therefore constitutes a primer to the principles and history of sensory substitution and augmentation, details the requirements and limitations of the enactive approach in academia and industry, and brings enactivity forward as an accessible, viable and exciting methodology in interaction design

Investigating the effect of sensory concurrency on learning haptic spatiotemporal signals

A new generation of multimodal interfaces and interactions is emerging. Drawing on the principles of Sensory Substitution and Augmentation Devices (SSADs), these new interfaces offer the potential for rich, immersive human-computer interactions, but are difficult to design well, and take time to master, creating significant barriers towards wider adoption. Following a review of the literature surrounding existing SSADs, their metrics for success and their growing influence on interface design in Human Computer Interaction, we present a medium term (4-day) study comparing the effectiveness of various combinations of visual and haptic feedback (sensory concurrencies) in preparing users to perform a virtual maze navigation task using haptic feedback alone. Participants navigated 12 mazes in each of 3 separate sessions under a specific combination of visual and haptic feedback, before performing the same task using the haptic feedback alone. Visual sensory deprivation was shown to be inferior to visual & haptic concurrency in enabling haptic signal comprehension, while a new hybridized condition combining reduced visual feedback with the haptic signal was shown to be superior. Potential explanations for the effectiveness of the hybrid mechanism are explored, and the scope and implications of its generalization to new sensory interfaces is presented.PostprintPeer reviewe

Walkers—encoding multivariate data into human motion sequences

The human perceptual system is highly efficient and effective at processing visual information, even at a pre-conscious level. Data visualisation leverages these functions to extract meaning and patterns from data, reducing cognitive load. Yet, the design of visualisations that represent multivariate data is still a challenge — as the number of data attributes increases, so does the complexity of visualisations, with it, the complexity of analysis processes potential users are facing. Many algorithms exist that support dimension reduction, leading to simpler, yet less nuanced visualisations in 2D space. We propose a novel way of presenting complex multivariate data using dimensional reduction that leverages humans’ ability to quickly process and decipher even complex sequences and compositions of motions to extract social cues. By encoding data into biomechanical motion of abstract figurines—“walkers”— and then using Point Light Displays to convey their motion in isolation, our proposed technique for data visualisation results in subconscious dimensional reduction and pattern recognition, enabling a meaningful overview of complex multivariate data with little cognitive effort. In this workshop paper, we introduce walkers as a novel visualisation concept and describe how this idea could be integrated into potential immersive analytics application scenarios. We also discuss the research questions that the idea of encoding data into biomechanical motion raises in the context of immersive analytics.PostprintPeer reviewe

A comparison of guiding techniques for out-of-view objects in full-coverage displays

Full-coverage displays can place visual content anywhere on the interior surfaces of a room (e.g., a weather display near the coat stand). In these settings, digital artefacts can be located behind the user and out of their field of view - meaning that it can be difficult to notify the user when these artefacts need attention. Although much research has been carried out on notification, little is known about how best to direct people to the necessary location in room environments. We designed five diverse attention-guiding techniques for full-coverage display rooms, and evaluated them in a study where participants completed search tasks guided by the different techniques. Our study provides new results about notification in full-coverage displays: we showed benefits of persistent visualisations that could be followed all the way to the target and that indicate distance-to-target. Our findings provide useful information for improving the usability of interactive full-coverage environments.PostprintPostprin

Adolescent Oxytocin Exposure Causes Persistent Reductions in Anxiety and Alcohol Consumption and Enhances Sociability in Rats

Previous studies have suggested that administration of oxytocin (OT) can have modulatory effects on social and anxiety-like behavior in mammals that may endure beyond the time of acute OT administration. The current study examined whether repeated administration of OT to male Wistar rats (n = 48) during a key developmental epoch (early adolescence) altered their physiology and behavior in later-life. Group housed rats were given intraperitoneal injections of either 1 mg/kg OT or vehicle during early adolescence (post natal-days [PND] 33–42). OT treatment caused a transient inhibition of body weight gain that recovered quickly after the cessation of treatment. At PND 50, the rats pre-treated with OT displayed less anxiety-like behavior on the emergence test, while at PND 55 they showed greater levels of social interaction. A subgroup of OT pre-treated rats examined at PND 63 showed a strong trend towards increased plasma OT levels, and also displayed significantly increased OT receptor mRNA in the hypothalamus. Rats pre-treated with OT and their controls showed similar induction of beer intake in daily 70 min test sessions (PND 63 onwards) in which the alcohol concentration of beer was gradually increased across days from 0.44% to 4.44%. However, when given ad libitum access to beer in their home cages from PND 72 onwards (early adulthood), consumption of beer but not water was significantly less in the OT pre-treated rats. A “booster” shot of OT (1 mg/kg) given after 25 days of ad libitum access to beer had a strong acute inhibitory effect on beer intake without affecting water intake. Overall these results suggest that exogenous OT administered during adolescence can have subtle yet enduring effects on anxiety, sociability and the motivation to consume alcohol. Such effects may reflect the inherent neuroplasticity of brain OT systems and a feed-forward effect whereby exogenous OT upregulates endogenous OT systems

Neurologists’ experiences of participating in the CODES study—A multicentre randomised controlled trial comparing cognitive behavioural therapy vs standardised medical care for dissociative seizures

Purpose We investigated neurologists’ experience of participating in the large CODES trial involving around 900 adults with dissociative seizures which subsequently evaluated the effectiveness of tailored cognitive behavioural therapy (CBT) plus standardised medical care versus standardised medical care alone in 368 patients with dissociative seizures. Method We asked all neurologists referring patients with dissociative seizures to the CODES study to complete a 43-item online survey. This examined neurologists’ (i) demographics, (ii) knowledge of dissociative seizures before and after their involvement in the CODES trial, (iii) clinical practice before, during and since their involvement, and (iv) their experience of the CODES trial. Results Forty-three (51%) neurologists completed the questionnaire. Only about half of neurologists could make referrals to psychological intervention specific for dissociative seizures before and after the trial. One-third of doctors reported having changed their referral practice following their involvement. The majority (>69%) agreed that patient satisfaction with different aspects of the trial was very high, and 83.7% thought that it was easy to recruit patients for the study. Over 90% agreed they would like the treatment pathway to continue. Respondents found different elements of the trial useful, in particular, the patient factsheet booklet (98%), diagnosis communication advice (93%) and the CBT package (93%). Conclusions Neurologists participating in CODES generally found it easy to recruit patients and perceived patient satisfaction as very high. However, 46.5% of neurologists could not offer psychotherapy once the trial had finished, suggesting that problems with lack of access to psychological treatment for dissociative seizures persist

Patient safety in palliative care: A mixed-methods study of reports to a national database of serious incidents.

BACKGROUND: Patients receiving palliative care are vulnerable to patient safety incidents but little is known about the extent of harm caused or the origins of unsafe care in this population. AIM: To quantify and qualitatively analyse serious incident reports in order to understand the causes and impact of unsafe care in a population receiving palliative care. DESIGN: A mixed-methods approach was used. Following quantification of type of incidents and their location, a qualitative analysis using a modified framework method was used to interpret themes in reports to examine the underlying causes and the nature of resultant harms. SETTING AND PARTICIPANTS: Reports to a national database of 'serious incidents requiring investigation' involving patients receiving palliative care in the National Health Service (NHS) in England during the 12-year period, April 2002 to March 2014. RESULTS: A total of 475 reports were identified: 266 related to pressure ulcers, 91 to medication errors, 46 to falls, 21 to healthcare-associated infections (HCAIs), 18 were other instances of disturbed dying, 14 were allegations against health professions, 8 transfer incidents, 6 suicides and 5 other concerns. The frequency of report types differed according to the care setting. Underlying causes included lack of palliative care experience, under-resourcing and poor service coordination. Resultant harms included worsened symptoms, disrupted dying, serious injury and hastened death. CONCLUSION: Unsafe care presents a risk of significant harm to patients receiving palliative care. Improvements in the coordination of care delivery alongside wider availability of specialist palliative care support may reduce this risk

Psychological and demographic characteristics of 368 patients with dissociative seizures: data from the CODES cohort

Background We examined demographic, clinical, and psychological characteristics of a large cohort (n = 368) of adults with dissociative seizures (DS) recruited to the CODES randomised controlled trial (RCT) and explored differences associated with age at onset of DS, gender, and DS semiology. Methods Prior to randomisation within the CODES RCT, we collected demographic and clinical data on 368 participants. We assessed psychiatric comorbidity using the Mini-International Neuropsychiatric Interview (M.I.N.I.) and a screening measure of personality disorder and measured anxiety, depression, psychological distress, somatic symptom burden, emotional expression, functional impact of DS, avoidance behaviour, and quality of life. We undertook comparisons based on reported age at DS onset (<40 v. ⩾40), gender (male v. female), and DS semiology (predominantly hyperkinetic v. hypokinetic). Results Our cohort was predominantly female (72%) and characterised by high levels of socio-economic deprivation. Two-thirds had predominantly hyperkinetic DS. Of the total, 69% had ⩾1 comorbid M.I.N.I. diagnosis (median number = 2), with agoraphobia being the most common concurrent diagnosis. Clinical levels of distress were reported by 86% and characteristics associated with maladaptive personality traits by 60%. Moderate-to-severe functional impairment, high levels of somatic symptoms, and impaired quality of life were also reported. Women had a younger age at DS onset than men. Conclusions Our study highlights the burden of psychopathology and socio-economic deprivation in a large, heterogeneous cohort of patients with DS. The lack of clear differences based on gender, DS semiology and age at onset suggests these factors do not add substantially to the heterogeneity of the cohort